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ABSTRACT 

If any one fact has emerged con 
International Project for the Evaluation of Edu 
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mean score for different countries is concerned 
can be posed with respect to these relationship 
substantial are the relationships, both vithin 
Are they merely "statistically significant," or 
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that ve obtained for background variables, thes 
more effective predictors than any of the items 
school as an educational unit. [Reproduced from 
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The Kelation of Ccliool Achieve: -eats to Differences 
ill the "i\ck5X-0UJids of Children. . 

Robert Thorndike 
If any one fact has eracrsed consistently in the ISTi studies of 
educational achieveiuents it is that achievonient is related to a var- 
iety of factors in the home background of children* Tliis is true so 
tox as differences in the achievements of single students vithin a 

country is concerned. It is also true so far as mean score for dlf- 

I. 

ferent coimtrles is concerned^ Several questions can bo posed vlth^ 
respect to these relaionships* Firstly, hov. substantial are the re- 
lationships, both within and hetifeen countries? Are they merely 
"statistically significant," or are tliey of a size that has "pr.ac- 
tical significance?" Secondly', hoTf stable are the relationships 
from subject natter to sub;jecfc matter and from country, to country? 
Are the factors that receive the ciost veiglit as predictors of reading 
the same as the ones that receive most vrelght for prediction of 
science or of liter atu:.*e? Are the factors that are nost predictive in 
the UtS^A.. also most predictive in England or Iran or Chile? If not, 
vhat reasonable explanation can be offered for the differences? 
Tliirdly, are the factors that are most predictive of Individual dif- 
ferences also the ones that are most predictive of national differ- 
ences? If not, vhat reasonable explanation can be offered for the 
differejnces? 

As a partial Qns\;er to the fir ;:t question, show in Table 1 
the median correlation over all countries for a number of home and 
conniuxiity variables. Correlations ere cho^vm i;ith score in Reading 
Comprehension, Science ?ad Literature Tests for gi'oic>s of 10-year- 
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olds, lU-yerr-olds, end stMooritc the end of crcoaiary cc]:ool, 
la addition. Table 2 chor.rr, the correlction Tor c ^»oic^itc5 cor.nocltc 
of the nore predictive of tJie^c v?ricblcs for each country tD?.:en 
scparato3i% Sable 1 shears vhich of the defeats of hone backipround 
taken sinsly sho;;ed sone nppreciable correlation vith the r.chieve- 
ment neasures* Table 2 shears ho:; nuch of a prediction iras possible 
fi*om coiinpoGites of the variables, end hovr liniforrn the relationship 
^^as fro:n covznti'y to co\uitr;''. 

The ^icdicn correlations in Table 1 are, in general, luite 
low. The two most predictive siik^le Items of Ixxformatioa are father' 
occtipatioa and nuztiber of booka in the home, yith correlation in the 
20 for lO-year-olds and lU-year-olds, but smaller at the encl of 
secozidary school. Other Iteros of information shou even smaller 
correletianjft. \Tay are the relationships no ^nore substantial than 
Ais? Tliere aro at least three nain contributing factors. One re- 
lates to the crudenesa of the data* Information vas obtained fro;a 
piq?ll*^. \fy questlonaire, and was typically reported in no more than 
five response categories • The response categories vere chosen so 
as to be most effective over the vholet ran^e of countries being 
studied. Thus, the question on bi^oks in the hosae read 

'*About how nany books are there in your horae? 

(Do not count newspapers or macazines) (Choose one) 

A. Ifone 

B. 1 - 10 books 
0, 11 - 25 books 
D. 2(5 - 50 boolis 

2. 51 or more books 
Tp shtw sone. of the problens of usins a questlonaire item 
such as thit. Internationally the proportions of responses ere shor.rn 
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below for 14-*7earwolda ia India and In Sweden* 



India Sweden 

A 0.9?^ 

B 35.9^ 2.0$^ 

C 22.5^ 1.0^ 



fhoufh the fire response categories eerre to bring out rery sharply 
the difference between India and Sweden in home circusistancesy thejr 
are not well chosen to differentiate the else of hone libraries in 
Sweden* Orer 70$^ of the responses fall in a single category*. trn«» 
der the oirciaastanoesy the correlation of 0*27 found for Sweden 
shottldf perhaps^ be considerod rather surprisingly high* Many itens 
inrolTed groupinss at least as coarse as the one illustrated* 

Or consider the coding of father's occupation* She basic datiua 
was the pupil's response to the Instructiont 

Please write your father's occupation* ■■■■ O n the lines be- 
loWf describe hie occupation as clearly as you can* 



Froa the statement provided by the pupil, a coder assigned the occu- 
pation to one of not more than zyjie categories* The categories 
were specified by each national center in texiis that made sense for 
that country* In the United Stateo the categories were: 
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9 Professional, tecl^lcal and kiJiCrci vovktra 

8 ISanagerOf offlolal;3 and proprietors) including 
farm owners and ffiuiagers 

7 Vhlte collar workers 

6 Skilled nanual trorkers 

5 Semi-ckilled trorkere 

4 Farm ^orkero, fishery, forestry and kindred groups 
3 Doscr:?tic and personal service workers 
2 laborers 

t 

1 Unolassifiable 
0 Ufiknotrn 

Scale Talues were cnpirically drtenoincd for each of the cattH- 
corlea so as to maxiiQlse the correlation of the sealed Tarlable with 
achl6Teaent« Howovcry the baslo categoxles were chosen nore la' termB 
of their denogrstphlc Lh&n of their paychometrio rcleTsacee Purther- 
^^.orsy coding was based on the liinited end ccsetiaes aaiblguetuB infor- 
cation suprliod ty tie pupil « The fact that an '^nclaseliriable*' 
catesory was required end was used fox 13 #6^ of the 10-yaar-^)lds, 
8.1^ of the 14-ycazwold8 CL^d at the end of secondai^ education 

in the United States serves to document the difficulty that coders 
experienced in workins with the Infonnation that the 'questionnaire 
supplied thjsi* Even 00| in the U.S.A. the correlation for this 
scaled \ triable rnxs 0.33 for lO-year^oldSt 0.29 for 14»yeaxwoies and 
for high cchool sc:ilors. 

?he second malr. attenuation In relationships my stem from in- 
correctness in the inforr.ation reported by pupils, especially the 10- 
ye&r-olds. Some prcllcilnavy vrork vs^ uone to check upon the depen«- 
dability of lJifnri2Uitlon reported in student <LuestlonAalres, Checkizig 
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•tudont r^porta against Infoxsnutlcn gathered from diroct contact with 
partnta or from oohool records* fhe agreement waa good enough to en- 
courage the project to continue to rely upon pupils aa the baalo 
source of Information about home and family clrcumatanoos» Butf of 
coursei the agreement toc not perfect* And moat of the pilot atudlea 
were doae In developed countrieQ irith a relatively high standard of 
literacy* One rcust question uhether the findings of these studies 
apply in developing covjitries \/here the average level of reading 
achievement iSy as our surveys have Indicated t much lower* As we 
shall see presently y it was in these developing countries 9 in which 
reading the the questionnaire items mtast have presented a veiy difficult 
reading task for many young people, that the correlations were lowest* 

She third point to be mentioned is that each of the variables 
represent a specific^ limitedf and somewhat indirect indicator of 
the total environment in which the child has grown up« Books repre«» 
sent one resource for intellectual stimulation of the child t but mag«- 
asinedy nevrapapero^ radio and television represent additional channela 
for Intelleotu&L stimulation* And sheer numbers of books tella nothing 
about the appropriateness of the books to a child or^ in fact| what 
aorta of books aro present t or whether anyone ever;re&ds them« 

If the indicators are individtially of only modest power aa pre- 
dictors of achieveaen*;;! how powerful are they as a team? Shis la 
the problem to which Table 2 provides some answer* She correlatlona 
here are for a conpooite home background variable t but the composite 
waa somewhat differently arrived at for the three subject areaa* la 
partlcularf items relating to reading resources in the home were ez« 
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eluded end treated separately in the Literct^zrc wials-i es, vbereas 
they vere included for the other two subjects, la eeneral. In the 
coniposite variable, coaiponent backjrouud factors vere so Treishted a5 to 
inaxlnlse the correlations of the cor.Tposite ^:ith the achievement nentsitro. 

We nov see correlatioas running as hish as O.^U, though the tj^p- 
ical. joint prediction falls coneuhere in the 30' s. The ran^e of cor- 
relations is q,ixite larse, Hcns^ are i.^e to intei^^ret this? 

ITote first that the correlations are tjT?ically nuch lover at the 
end of secondary school* . In xnost countries, the s^^oup still in achool 
at the end of secondary school is quite a select sro\rp*-ai]yvrhere from 
. 10 to 23 percent of the age oprortp, the remainder having already drop- 
ped out of sehool. Selectivity has operated on the basis of some con- 
bination of academic cosine bence and socio-economic status. Most of 
those troDi the lower socio--economic ^oupings have dropped out unlesg 
they vere especially con^etent. Thus, the selection has operated both 
to reduce the range of socio-^^conomic status and leiiie In school a 
very non-representative fraction of children from the lov;er soclo- 
econwdc strata. As a result, correlations have almost xinlversaUy 
dropped. The "one exception is the United States, vhere perhaps 7% of 
the age groi^ completes secondary school, and vhere socio-economic var- 
iables appear less related to the fact of dropping out of school* In 
the U.S.A. the prediction of achievement for l3-;^ar-olds is abovit as 
accwate as at the earlier levels. 

Zh addition to the difference betmen the end-of -secondary school 
and the younger groirps, there are notable differences between countries. 
Considerins reading coriprehension, one notes corqposlte correlations cs 
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high as 0.54 In iBraelt 0*33 in Bngload and O.^l in Scotland and the Unl 
ted States, while composite correlations reach 0&I7 0.14 in Chile (for 
IO-year-*olds) and 0.15 in India. Rov are those differences to be un«» 
derstood? 

One explanation would cay that the countries that shoRf the low 
correlations are very hoaojeneousj that there is little variation from 
p\;cpil to pupil in the socio-economic indices in question, and coi^se- 
quentl^y*- little opportxmity for co-voriation to arpear. This explanation 
can aT)parentl5^ "be rejected. At least, vhen ve took three separate vari- 
ables for iV-year-olds, and exeinined the relatonship hetveen national 
variability (standard deviation of responses on the scaled item) and 
national correlation vrith reading cos^rehension score the correlations 
were in each instance negative • The countries vith the greater vari- 
ability shof;;ed the smaller correlations. This negative value is prob- 
eJbly not to be taken seriously, but it does at least argue against 
any slsnificant positive relationship. 

A second explanation would assert that in the developing countries 
many pupils were sinply unable to read and respond meaningfully to the 
student questionalre. It became clear, as the test papers fran the lEA 
study were processed, that many pi5>ils in the three develppinj coun- 
tries (CJhile, India end Iran) were responding at or close to a chance 
level on the reading tests. Tests that were designed to he, and in 
fact were of approprxate difficulty for the typical pupil In the de- 
veloped countries of Europe and its derivatives were clearly too dif- 
ficult for children in these three countries. Since the student ques- 
tionaire was in a sense a test of reading and of follo\ri.n£ Cdrections, 
and very probably as difficult as the lO-j'ear-old version of the Read- 
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ixks Comprehension Testi it 6cem3 reasonable to suppose that those who 
were unable to handle the reading toatf responding to it in a randx)a 
fashlont were also unable to handle the quostiomiaire and^^sioy hare res- 
ponded to its questions in a near^randoa fashion. Future inrestiga** 
tors working with aiarginally literate populations may need to develop 
other approaches ^to obtaining bacl^ground information about their sub- 
jects. 

A third erplfuiatloa, Vi'hich does not oxcluda thrj previous one as a 
contributory factor^ is that the sane indicator may have genuinely 
different significance in different cultures. As an ezamplef we aay 
take nuaber of siblings. This variable showed a negative correlation 
with achievement in all but one of the developed countsrleSf the one ex- 
ception being the Pleaiieh-9peaking area of Belgium. However^ the cor^ 
relation was positive in several of the developing countriesy e.g.f In- 
dia^ Iranf and Thailand. Perhaps a snail faolly signifies qualities of 
restraint^ planfulness and concern for children's education In most Eur- 
opean-baaed western co\mtrie3f but has quite different implications for 
developing countries in the Ee.st. As another illufitrationf occupation- 
al level tuxue out to be a luuch weaker prodictor in such countries as 
Indla^ Iran and Thailand. Possibly in these countries there is no 
clear-cut occupatioml hierarchy that has the same connotation of eco- 
nomic advantage and cultural stianilation that seems to attach to this 
hierarchy in the developed Suropean-based coxmtries. 

It is hard to judge whether such differences do exist in the basic 
significance of indicators until it ie possible to rule out reading dif- 
ficulties as a contributinc: factor. A future study in which Information 
about home and family Id gathered at the sourcei that is^ from a parent^ 
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*by a trainci Intetviovcr, voi-ld S6Gm to bo ro^-airvtc: iC or.c ir; to rcc\ch 
a Jwlscment es to the voiji'o bo "be at^r.c^.e-* to tlio tvo o::plr.a:*.tory fac- 
tors* 

Table 1 provides sovic evidence on the consistency of the r<i»ls.* 
tioxisliip of backcround variables as one G035 froifi one c^go level to an- 
other. Except for the fact that all correlations ere lower for the I8- 
year-olfia, consistency acro'^s ages and subjects scens to be the ruile, 
and variations appear to be relativ^li*- rdnor. There is perhcaps a sug- 
gestion that the availcbility of readins matter in the home is less im- 
portant for science echieverr.ent than for achievenent iA reading and 
Uteratxare. Uofortixnately, no data vere gathered on hoine variables 
that might have been niore related to aeience- -possibly such an item as 
the availability of tools and a hosie workshop, or having a parent vfao 
carried out a vide variety of home repairs*-- so no variables appear that 
shofw a stronger relationship to achievement in science. Of course, sex 
of student is the one major exception to the consistent pattern, since 
boys tend to do markedly better on the science tests and girls on the 
Uteratxire tests. 

There were a few surprises in the relationships that emerged, op 
sometimes those that failed to emerge* One group of variables was in- 
troduced to measure the home*s level of interest in schooling and the 
home press for achle^/ement* These vere items that attempted to tap 
via q:ue6tionalre some of the aspects of the hone that had been found 
la Interviei^-observatlon studies to shov? a strong positive relationship 
to achievement of a child. There were items such as: 

Hoif often does your mother or father help you vriLth your homework? 

When you talk at home, do your parents insist that you speak correctly? 

Vlhen you get home from school, do your parents ask about your scboolwork? 
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Ho::ever, exrxidnatlon of Tabic 1 chows that the correlations In thia stUiiy 
were all snail and vere sometimes neGatl^/e* In pcrticular, it appears • 
that the p^?il*s report that his parents xi3lp hin '.?lth his homc^rork is 
laore en indication of childish ineptitude than of parental cormnitTaent. 
J The correlation vns negative practically 'Without exception for ell 

countries, all subjects and all levels. Perhaps parental behavior as 
seen and reported hy a pupil is quite different fron parental behavior 
as re?ort(?-d by a parent or seen by an ad^xLt observer. But nore likely 
the information obtainable by questionnaire is getting at a different 
l^rpe or level of parent involvement than is gotten by loore probing ap* 
proaches. 

Table 2 provides sone evidence on the consistency of predictloa 
throitgh baclcsround variables as one eoes from cowtry to country. At- 
tention has already been directed to the relatively loir values in Chile, 
India and Bran, and for all countries but the United States at the exid 
of .secondary school, and possible explanations for these results have 
been proposed. A further question nJLsht be: to vhat extent is a country 
consistently hlgja or lovz In the predictability of achievement? As one 
answer to this, \re have co2:5)uted a coeffic t of concordance over sev- 
eral of the better predictors cjnd over the two subject areas of reading * 
and science. Thus, for each predictor the available countries ^^eve 
ranked for size of correlation coeficlent, both for 10-year-olds and lU- 
year-olds and the concordance of the ranks determined. For science the 
coeficlent of concordance vas 0.75 and the average rank order correlation vas 
©•70; for readinc the correcpondins values were 0.8l and 0.78. Thus, . 
there Is a substantial amount of consistency both over predictors and 
over aise groups in the countries in \7hich prediction from background var- 
Q lables is effective. An overall ranking of 13 countries from most to 
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least predictable would result in the foUowins order: 

1. Scotland 

2. England 
3« Hxingary 

United States 
5 • Finland 

6. Belgix;iia (French-speahins). 

7. Chile 

8. Si7eden 

$• Netherlands 
10* Italy 
U. Iran 

12, Belglxca (Fleiaish-speaJcing) 

13. India 

It Is interesting to speci^ate on what accounts for this order. 
As previously noted, prediction was relatively poor in the developing 
countries, especially I^an and India, and possible reasons have been 
offered for this finding. One notes that prediction Is especially good 
in the English^speeldLng countries. This could reflect the fact that all 
the tests and questloxinaires were ixiitiaUy developed in the English Ian* 
guage. The tests vere sli^tly more reliable in English-speaiing coxin- 
tries ^ and it is possible that the questionnaire items were soniehoa/ clear 
er, leading to more precise responses. But \ihy does Hungary fall so 
near the top? ^^hy is Fleiaish-speaklng Beigiun so near the bottom? 

So far we have considered background factors as predictors of thei 
achievements of individual children. Wiat about the prediction of be- 
tween-country differences? Do national differences in the availability 
of books In the home, for exarr^le, correspond to national differences 
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in achievement? Gone c^^ridencc on this pro'blsia ic provided in Tabic 3> 
irtiere correlations are shovn "bctt^'eon r.verace readin:^ couxprehcnsion 
score auid avercse score on eech of a mrtiber of bcclccround variables. 
Correlations ere chovn vlth the three developing countries included^ 
and also idLth tbese countries removed. 

From Table 3 it is appeorent that any of a nvanber of background, var- 
iables corresponds fairly veil \7ith average achievenent if the three dev- 
eloping countries are included. Hovrever, v'aerx these tliree countries 
are omitted> the correlations are Generally quite sniall, and quite a 
different set of variables are the best predictors. It is also true 

^ . i 

tliat the variables that best differentiate among countries are not the 
saioe as those that best differentiate ai&ong individuals. ?or exainple^ 
azaojag the developed countries number of masazines differentiates better 
than number of books, vhereas for individual pupils the order Is quite 
the reverse. Asain, as betveen countries the report that parents help 
vlth homerrork is a favorable indicator, while as beti>'een pupils within 
a country it is an unfavorable one. As between countries, tlsie devoted 
t>o TV and radio is as povrerful an indicator as tine spent reading for 
pleasiare; for individuals reading time is very much more predictive. It 
cip!pears that the dynamics of prediction across countries is rather 
different from the dynamics across individuals. One interpretation 
vould be that indicators of economic development are more potent across 
countries, vhereas indicators of cultural enriclment are more potent a- 
cross individuals. 

In the EA studies some attention \ms also pr.id to school charac- 
teristics as indicators of achievement. In those analj'ses it was extreme- 
ly liaportant to partial out the influence of background variables of the 
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fiorts consWcrei in thin pn?cr. 2r.cV:cro;»ncl fc.ctors vhich ^rr.ve corre- 
Ictions of crouaA O.30 gs 'oetwecn ladixlduals i^leldcd correlations aa 
hl(ih &8 0.70 vhen deelins vitli aversce input and avorase cchievcraent 
for a school. iSar co:ii.arlso.i, nost school varittlen (that is, variables 
^.escribins sone aspect of schoolina v-itMn a school) cer/e small corrc- 
lations and ones that vere erratic and inconsistent froM country to 
countr/. Thus, in spite of the modect correlations that we obtained 
for. baclsGTound variables, these see^ied to be cuch :aore effective pre- 
dictors than any of the Itens that described the school as an educa- 
. tloaal unit. If direct measures had l»een available of the chlldrca as 
tbor entered school, even higher correlations vould aljaost certain^ 
have been ^btalned between pupU inp^it and averese achievement. In 
•aansr countries, of vhlch the United States Is one, the Input variables 
- delialt rather sharply the range of outputs that it Is reasonable to ex- 
pect for a school. Thus, thousli the hoiae bacil;3rouad factors provide 
ohly a rou^ guide to eaqpected Individual performance, they define 
rather sharply the expected perforaance of a school. 
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M»dlaa Correlatio n. Acroaa Countrlea. of Baekground Paotorg and Indlrldual 
Achl«Tenent (Deolnal points oadttedj ' ' ■ . 
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Tsble 2 

(DcciDurl points in cDrrelel;ions or-iittcdj 
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Fed. Bep. Ger. 






-- 


20 

• 


31 


Ql 




m^ 


?ialand 


33 




13 


23 


3b 


10 


30 


06 


Fk'ance 








— 






mm 


mm 


Rongary 




U7 


29 


25 


31 


22 


m* 




iDdia 


15 


18 


16 


07 


15 


18 






Jr^ 


33 


23 


22 


19 


•17 


09 


20 


20 


Israel 


5U 


5h 


30 












IteJIy 


31 


33 


27 


18 


16 


17 


21 


20 


J^pan 








33 


38 








Netherlands - 


35 


37 


15 


30 


27 


08 






Rev Zealajod 




1*1 


20 




33 


07 


25 


08 


Scotland 


U6 


51 


23 


U2 


1*8 


lU 






Sweden 


30 


Ul 


27 


27 


28 


13 


21 


11 


Thailand 










31 


mm 






0.8. A. 


hz 


51 


U6 


bo 


Ul 


31 


32 


27 



^ata not available in this country for this subject 



Tabic 3 

Correlations of Country ■ -onn nesdln:; Compreh^iuion vith Other ITatlonal 

Vorisblest ropulation II 

Variable All 13 12 Developed 





Countries 


Coutitries 


£ aT^ner s ecrncaoxon. 


Ark 


• 14 


I'lOvHcr 5 eaucation 


•73 


• 23 


liXpoctoa eaucai;ion 


• Of 




Hours honievorlc weekly 


•25 


•19 


HouDTfl lA8tructl6xi«^«*XDother tonsvM 


•21 




Psreata help vlth hocnevork 


•53 


•13 


Fai^eats eocourace to read 


* 15/; 


Ak 


Pareats interested in school 


.07 




Dictionory available 


.09 


•25 

• 


ITasiber of books In home 


.05 


.17 


Btnaber of magazines 


•TL 


.36 


Hours radio or TV 


.92 


.28 


Freqiuency xoovie attendance 


.23 


.07 


Hours reading for pleasure 


.16 


.29' 



